-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New Components - chattermill #17649
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
New Components - chattermill #17649
Conversation
WalkthroughThis update introduces a Chattermill integration, adding a polling source for new responses and multiple actions: creating, updating, retrieving, and searching responses. The implementation includes utility functions, a fully featured app interface for Chattermill API interactions, and a test event fixture for the source component. The package metadata is also updated. Changes
Sequence Diagram(s)sequenceDiagram
participant User
participant Action
participant ChattermillApp
participant ChattermillAPI
User->>Action: Trigger (e.g., Create/Update/Get/Search Response)
Action->>ChattermillApp: Call method (e.g., createResponse, updateResponse)
ChattermillApp->>ChattermillAPI: Make HTTP request
ChattermillAPI-->>ChattermillApp: Return API response
ChattermillApp-->>Action: Return result
Action-->>User: Return summary and data
sequenceDiagram
participant Source
participant ChattermillApp
participant ChattermillAPI
participant DB
Source->>DB: Get last processed timestamp
Source->>ChattermillApp: Fetch responses newer than last timestamp
ChattermillApp->>ChattermillAPI: GET /responses
ChattermillAPI-->>ChattermillApp: Return response list
ChattermillApp-->>Source: Return responses
Source->>Source: Emit events for each new response
Source->>DB: Update last processed timestamp
Assessment against linked issues
Assessment against linked issues: Out-of-scope changes
Poem
Warning There were issues while running some tools. Please review the errors and either fix the tool's configuration or disable the tool if it's a critical failure. 🔧 ESLint
components/chattermill/actions/create-response/create-response.mjsOops! Something went wrong! :( ESLint: 8.57.1 Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'jsonc-eslint-parser' imported from /eslint.config.mjs components/chattermill/chattermill.app.mjsOops! Something went wrong! :( ESLint: 8.57.1 Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'jsonc-eslint-parser' imported from /eslint.config.mjs 📜 Recent review detailsConfiguration used: CodeRabbit UI 📒 Files selected for processing (2)
🚧 Files skipped from review as they are similar to previous changes (1)
🧰 Additional context used🧠 Learnings (1)components/chattermill/chattermill.app.mjs (2)⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (4)
🔇 Additional comments (4)
✨ Finishing Touches
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. 🪧 TipsChatThere are 3 ways to chat with CodeRabbit:
SupportNeed help? Create a ticket on our support page for assistance with any issues or questions. Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (Invoked using PR comments)
Other keywords and placeholders
CodeRabbit Configuration File (
|
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 3 Skipped Deployments
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 2
🧹 Nitpick comments (1)
components/chattermill/common/utils.mjs (1)
1-25: LGTM! Well-structured recursive parser with minor suggestion.The
parseObjectfunction correctly handles recursive parsing of nested data structures. The logic for handling different data types (strings, arrays, objects) is sound and appropriate for the Chattermill integration use case.Consider adding more specific error handling in the JSON parsing catch block to log parsing failures for debugging purposes, though the current fallback behavior is acceptable.
try { return JSON.parse(obj); - } catch { + } catch (e) { + // Return original string if JSON parsing fails return obj; }
📜 Review details
Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro
⛔ Files ignored due to path filters (1)
pnpm-lock.yamlis excluded by!**/pnpm-lock.yaml
📒 Files selected for processing (9)
components/chattermill/actions/create-response/create-response.mjs(1 hunks)components/chattermill/actions/get-response/get-response.mjs(1 hunks)components/chattermill/actions/search-responses/search-responses.mjs(1 hunks)components/chattermill/actions/update-response/update-response.mjs(1 hunks)components/chattermill/chattermill.app.mjs(1 hunks)components/chattermill/common/utils.mjs(1 hunks)components/chattermill/package.json(2 hunks)components/chattermill/sources/new-response-created/new-response-created.mjs(1 hunks)components/chattermill/sources/new-response-created/test-event.mjs(1 hunks)
🧰 Additional context used
🧠 Learnings (8)
components/chattermill/package.json (1)
Learnt from: jcortes
PR: PipedreamHQ/pipedream#14935
File: components/sailpoint/package.json:15-18
Timestamp: 2024-12-12T19:23:09.039Z
Learning: When developing Pipedream components, do not add built-in Node.js modules like `fs` to `package.json` dependencies, as they are native modules provided by the Node.js runtime.
components/chattermill/actions/search-responses/search-responses.mjs (2)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-07-04T18:11:59.822Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-10-08T15:33:38.240Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
components/chattermill/sources/new-response-created/test-event.mjs (2)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#14265
File: components/the_magic_drip/sources/common.mjs:35-43
Timestamp: 2024-10-10T19:18:27.998Z
Learning: In `components/the_magic_drip/sources/common.mjs`, when processing items in `getAndProcessData`, `savedIds` is intentionally updated with IDs of both emitted and non-emitted items to avoid emitting retroactive events upon first deployment and ensure only new events are emitted as they occur.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#15376
File: components/monday/sources/name-updated/name-updated.mjs:6-6
Timestamp: 2025-01-23T03:55:15.166Z
Learning: Source names in Monday.com components don't need to start with "New" if they emit events for updated items (e.g., "Name Updated", "Column Value Updated") rather than new items. This follows the component guidelines exception where the "New" prefix is only required when emits are limited to new items.
components/chattermill/actions/update-response/update-response.mjs (2)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-07-04T18:11:59.822Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-10-08T15:33:38.240Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
components/chattermill/actions/get-response/get-response.mjs (2)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-07-04T18:11:59.822Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-10-08T15:33:38.240Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
components/chattermill/sources/new-response-created/new-response-created.mjs (6)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#14265
File: components/the_magic_drip/sources/common.mjs:35-43
Timestamp: 2024-10-10T19:18:27.998Z
Learning: In `components/the_magic_drip/sources/common.mjs`, when processing items in `getAndProcessData`, `savedIds` is intentionally updated with IDs of both emitted and non-emitted items to avoid emitting retroactive events upon first deployment and ensure only new events are emitted as they occur.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12697
File: components/salesforce_rest_api/sources/common.mjs:97-98
Timestamp: 2024-07-24T02:05:59.531Z
Learning: The `processTimerEvent` method in the `components/salesforce_rest_api/sources/common.mjs` file is intentionally left unimplemented to enforce that subclasses must implement this method, similar to an abstract class in object-oriented programming.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#15376
File: components/monday/sources/name-updated/name-updated.mjs:6-6
Timestamp: 2025-01-23T03:55:15.166Z
Learning: Source names in Monday.com components don't need to start with "New" if they emit events for updated items (e.g., "Name Updated", "Column Value Updated") rather than new items. This follows the component guidelines exception where the "New" prefix is only required when emits are limited to new items.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#17538
File: components/aircall/sources/new-sms/new-sms.mjs:19-25
Timestamp: 2025-07-09T18:07:12.426Z
Learning: In Aircall API webhook payloads, the `created_at` field is returned as an ISO 8601 string format (e.g., "2020-02-18T20:52:22.000Z"), not as milliseconds since epoch. For Pipedream components, this needs to be converted to milliseconds using `Date.parse()` before assigning to the `ts` field in `generateMeta()`.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12697
File: components/salesforce_rest_api/sources/common-webhook-methods.mjs:1-71
Timestamp: 2024-07-24T02:06:47.016Z
Learning: The `common-webhook-methods.mjs` object is designed to be extended, similar to an abstract class, and intentionally does not implement certain methods like `generateWebhookMeta` and `getEventType` to enforce implementation in subclasses.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12697
File: components/salesforce_rest_api/sources/common-webhook-methods.mjs:1-71
Timestamp: 2024-10-08T15:33:38.240Z
Learning: The `common-webhook-methods.mjs` object is designed to be extended, similar to an abstract class, and intentionally does not implement certain methods like `generateWebhookMeta` and `getEventType` to enforce implementation in subclasses.
components/chattermill/actions/create-response/create-response.mjs (3)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-07-04T18:11:59.822Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#12731
File: components/hackerone/actions/get-members/get-members.mjs:3-28
Timestamp: 2024-10-08T15:33:38.240Z
Learning: When exporting a summary message in the `run` method of an action, ensure the message is correctly formatted. For example, in the `hackerone-get-members` action, the correct format is `Successfully retrieved ${response.data.length} members`.
Learnt from: jcortes
PR: PipedreamHQ/pipedream#14467
File: components/gainsight_px/actions/create-account/create-account.mjs:4-6
Timestamp: 2024-10-30T15:24:39.294Z
Learning: In `components/gainsight_px/actions/create-account/create-account.mjs`, the action name should be "Create Account" instead of "Create Memory".
components/chattermill/chattermill.app.mjs (2)
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#16954
File: components/salesloft/salesloft.app.mjs:14-23
Timestamp: 2025-06-04T17:52:05.780Z
Learning: In the Salesloft API integration (components/salesloft/salesloft.app.mjs), the _makeRequest method returns response.data which directly contains arrays for list endpoints like listPeople, listCadences, listUsers, and listAccounts. The propDefinitions correctly call .map() directly on these responses without needing to destructure a nested data property.
Learnt from: GTFalcao
PR: PipedreamHQ/pipedream#16954
File: components/salesloft/salesloft.app.mjs:14-23
Timestamp: 2025-06-04T17:52:05.780Z
Learning: The Salesloft API list endpoints (listPeople, listCadences, listUsers, listAccounts) return arrays directly in the response body, not wrapped in a metadata object with a nested data property. The _makeRequest method correctly returns response.data which contains the arrays that can be mapped over directly in propDefinitions.
🔇 Additional comments (10)
components/chattermill/package.json (2)
3-3: LGTM! Appropriate version increment for new features.The version bump from 0.0.1 to 0.1.0 correctly follows semantic versioning for a minor release that includes new functionality.
15-16: LGTM! Proper dependency addition.The
@pipedream/platformdependency is correctly added and appropriate for Pipedream component development.components/chattermill/sources/new-response-created/test-event.mjs (1)
1-27: LGTM! Comprehensive test event structure.The test event provides a well-structured sample that covers all expected response fields including nested user attributes, timestamps, and various data types. This will be valuable for testing and development purposes.
components/chattermill/actions/search-responses/search-responses.mjs (3)
39-42: LGTM! Excellent validation logic.The validation ensures that filter property and value are provided together, preventing invalid API calls. The use of
ConfigurationErroris appropriate for this validation scenario.
44-56: LGTM! Proper pagination implementation.The use of
getPaginatedResourceswith appropriate parameters follows Pipedream best practices for handling paginated API responses.
58-58: LGTM! Correctly formatted summary message.The summary message format follows the established pattern from the retrieved learnings, providing clear feedback on the number of results found.
components/chattermill/actions/get-response/get-response.mjs (2)
17-25: LGTM! Proper dependent property implementation.The
responseIdproperty correctly depends on theprojectIdselection, providing a good user experience by filtering responses based on the selected project.
27-35: LGTM! Clean and correct implementation.The
runmethod implementation is straightforward and follows best practices. The API call is properly structured and the summary message format is consistent with Pipedream standards.components/chattermill/actions/update-response/update-response.mjs (1)
42-57: LGTM!The run method correctly implements the update response logic with proper parameter handling and summary message formatting.
components/chattermill/chattermill.app.mjs (1)
142-177: Well-implemented pagination logicThe pagination implementation correctly handles:
- Async iteration with proper yielding
- Early termination when max is reached
- Page increment logic
- Edge case handling for empty results
The
getPaginatedResourceshelper is also useful for cases where all results need to be collected.
components/chattermill/sources/new-response-created/new-response-created.mjs
Show resolved
Hide resolved
jcortes
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @michelle0927 lgtm! Ready for QA!
|
/approve |
Resolves #17291
Summary by CodeRabbit
New Features
Chores